Real-Time 3D Virtual or Physical Model Generating Apparatus for HoloPortal and HoloCloud System

ABSTRACT

A novel electronic system provides fast three-dimensional model generation, social content sharing of dynamic three-dimensional models, and monetization of the dynamic three-dimensional models created by casual consumers. In one embodiment, a casual consumer utilizes a dedicated real-time  3 D model reconstruction studio with multiple camera angles, and then rapidly create dynamic  3 D models with novel computational methods performed in scalable graphics processing units. In another embodiment, uncalibrated multiple sources of video recording of a targeted object are provided by a plurality of commonly-available consumer video recording devices (e.g. a smart phone, a camcorder, a digital camera, etc.) located at different angles, after which the uncalibrated multiple sources of video recording are transmitted to a novel cloud computing system for real-time temporal, spatial, and photometrical calibration and  3 D model reconstruction. The dynamic  3 D models can be uploaded, listed, and shared among content creators and viewers in an electronic sharing platform.

BACKGROUND OF THE INVENTION

The present invention generally relates to digital image processing. Thepresent invention also relates to an improvement in functioning of oneor more computers by improving digital image processing methods forcomputer-generated graphical objects. Furthermore, the present inventionrelates to three-dimensional (3D) image creation, sharing, andmonetization. More specifically, the present invention relates to one ormore electronic systems that provide rapid three-dimensional (3D) modelgeneration, 3D model social content sharing, and monetization of 3Dmodels in e-commerce and mobile ecosystems.

Wearable virtual reality (VR) devices, such as VR goggles and VRheadsets, are increasingly being utilized in computer gaming, augmentedreality, situation simulation training, and other applicablecomputerized applications in recent years. More than two hundred VRgoggles are currently marketed as consumer electronics products withrelated electronic hardware to provide three-dimensional (3D) virtualreality graphical environment to users.

Unfortunately, conventional methods of virtual reality (VR) contentcreation is generally time-consuming and expensive, thus serving as abottleneck to widespread adaptation and utilization by casual users whoare not computer-graphics experts. For example, designing one animated3D character for a computer game often costs approximately $500,000 USDwith two months of graphical design refinements. Furthermore, theaverage cost of producing a 3D computer game to completion may cost upto $200 million USD with years of computer graphics work. In addition,360-degree virtual reality video cameras, which are utilized to captureimages of a real object (e.g. a human model or another desirable objectfor rendering) in various angles prior to rendering of the also-costlyconventional 3D model generation, have equipment prices ranging from$1,500˜$500,000 USD.

The high costs of 3D model production and related electronic equipmentand an extensive time delay in 3D model generation are roadblocks towidespread and ubiquitous creation of 3D virtual reality contents invarious electronic applications by casual users. Therefore, it may bebeneficial to provide a novel electronic system that can inexpensivelycapture live objects and rapidly generate 3D models with common consumervideo recording equipment and cloud computing resources. Furthermore, itmay also be beneficial to provide multiple and flexible methods ofcapturing live objects to achieve fast real-time creation of 3D models.Moreover, it may also be beneficial to provide a novel electronicplatform that accommodates convenient sharing and monetization of casualuser-created 3D models and related multimedia data. In addition, it mayalso be beneficial to provide a novel virtual and physical 3Dmodel-generating apparatus that incorporates the novel electronicsystem.

SUMMARY

Summary and Abstract summarize some aspects of the present invention.Simplifications or omissions may have been made to avoid obscuring thepurpose of the Summary or the Abstract. These simplifications oromissions are not intended to limit the scope of the present invention.

In a preferred embodiment of the invention, a real-time 3D virtual andphysical body double-generating apparatus is disclosed. This apparatuscomprises: a HoloPortal electronic system that incorporates a dedicatedphysical studio space, which is configured to capture, calibrate,calculate, reconstruct, and generate graphical transformation of atarget object to create an electronic 3D body double model; a HoloCloudelectronic system comprising consumer-level portable video recordingdevices positioned circularly around the target object and generate aplurality of multiple-angle video data streams, a scalable number ofgraphics processing units (GPU's) that execute a pre-processing moduleand a 3D reconstruction module for calibrating, calculating,reconstructing, and generating graphical transformations to create theelectronic 3D body double model that resembles the target object, and awireless transceiver that transmits the plurality of multiple-anglevideo data streams from the consumer-level portable video recordingdevices to the scalable number of GPU's; a 3D printer device connectedto at least one of the HoloPortal electronic system and the HoloCloudelectronic system, wherein the 3D printer device manufactures a physicalreplica of the electronic 3D body double model previously created by theHoloPortal electronic system or the HoloCloud electronic system, when auser requests production of the physical replica; a 3D model and contentdatabase configured to store the electronic 3D body double model createdfrom the HoloPortal electronic system or the HoloCloud electronicsystem; an electronic 3D content sharing software executed on a computerserver connected to the 3D model and content database, wherein theelectronic 3D content sharing software is configured to upload, list,transmit, and share 3D model animations and 3D contents derived from theelectronic 3D body double model, and wherein the electronic 3D contentsharing software is further configured to accommodate a user request topurchase or sell the physical replica of the electronic 3D body doublemodel; and a client-side 3D content viewer and management user interfaceexecuted on a notebook computer, a desktop computer, a mobilecommunication device, or a web server, wherein the client-side 3Dcontent viewer and management user interface is configured to purchase,sell, transmit, receive, or playback a 3D content incorporating theelectronic 3D body double model via the electronic 3D content sharingsoftware and the 3D model and content database.

Furthermore, in one embodiment of the invention, a dedicated real-timemodel reconstruction studio (e.g. “HoloPortal” studio) with multiplecamera angles and graphics processing equipment captures a live video ofa targeted object, and then rapidly create dynamic 3D models inreal-time by applying a novel graphics processing algorithm (e.g. stepsshown in FIG. 1 or FIG. 3).

In another embodiment of the invention, uncalibrated multiple sources ofvideo recording of a targeted object are provided by a plurality ofcommonly-available consumer video recording devices (e.g. a smart phone,a camcorder, a digital camera, etc.) located at different angles, afterwhich the uncalibrated multiple sources of video recording aretransmitted to a novel cloud computing system (e.g. HoloCloud) forreal-time temporal, spatial, and photometrical calibration and 3D modelreconstruction.

Yet in another embodiment of the invention, a dynamic 3D model generatedand reconstructed through the novel graphics processing algorithm in aHoloPortal system or a HoloCloud system is uploaded to a novelelectronic platform that generates 3D virtual reality display andsharing user interfaces and database organization environment fordynamic 3D model content sharing and/or monetization.

Yet in another embodiment of the invention, a dynamic 3D model (e.g. acomputerized 3D model in a virtual reality environment, a hologram,etc.) generated and reconstructed through the novel graphics processingalgorithm in a HoloPortal system or a HoloCloud system is manufacturedas a physical 3D model from a 3D printer or produced as a portablehologram that can be carried or reproduced from one location to another.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 shows a process diagram for rapid three-dimensional modelgeneration from a dedicated real-time model reconstruction studio withmultiple camera angles, in accordance with an embodiment of theinvention.

FIG. 2 shows a rapid three-dimensional model generation fromuncalibrated multiple sources of video recording of a targeted objectand subsequent cloud computing-based video data calibration andthree-dimensional reconstruction of the targeted object, in accordancewith an embodiment of the invention.

FIG. 3 shows pre-processing and reconstruction procedures in cloudcomputing-based video data calibration and three-dimensionalreconstruction of the targeted object, in accordance with an embodimentof the invention.

FIG. 4 shows a ubiquitous and rapid three-dimensional model contentgeneration by casual (i.e. non-graphics expert) consumers and robustsocial sharing of virtual reality contents in a 3D content sharingplatform, in accordance with one or more embodiments of the invention.

FIG. 5 shows an electronic social sharing platform for casual consumer's3D and/or virtual reality contents generated from a dedicated studiosystem (HoloPortal) or from a plurality of consumer devices connected toa cloud-based 3D model generation system (HoloCloud), in accordance withan embodiment of the invention.

FIG. 6 shows a business model example for content generators, contentviewers, and an electronic social sharing platform for 3D modelcontents, in accordance with an embodiment of the invention.

FIG. 7 shows third party add-on applications to the 3D model generation,social content sharing, and monetization systems, in accordance with anembodiment of the invention.

DETAILED DESCRIPTION

Specific embodiments of the invention will now be described in detailwith reference to the accompanying figures. Like elements in the variousfigures are denoted by like reference numerals for consistency.

In the following detailed description of embodiments of the invention,numerous specific details are set forth in order to provide a morethorough understanding of the invention. However, it will be apparent toone of ordinary skill in the art that the invention may be practicedwithout these specific details. In other instances, well-known featureshave not been described in detail to avoid unnecessarily complicatingthe description.

The detailed description is presented largely in terms of description ofshapes, configurations, and/or other symbolic representations thatdirectly or indirectly resemble one or more real-time 3D virtual and/orphysical model generating apparatuses and related methods of operation.These process descriptions and representations are the means used bythose experienced or skilled in the art to most effectively convey thesubstance of their work to others skilled in the art.

Reference herein to “one embodiment” or “an embodiment” means that aparticular feature, structure, or characteristic described in connectionwith the embodiment can be included in at least one embodiment of theinvention. The appearances of the phrase “in one embodiment” in variousplaces in the specification are not necessarily all referring to thesame embodiment. Furthermore, separate or alternative embodiments arenot necessarily mutually exclusive of other embodiments. Moreover, theorder of blocks in process flowcharts or diagrams representing one ormore embodiments of the invention do not inherently indicate anyparticular order and do not imply any limitations in the invention.

One objective of an embodiment of the present invention is to provide anovel electronic system that can inexpensively capture multiple-anglevideos of a target object, after which three-dimensional computerizedmodels are rapidly generated in real time or near real time.

Furthermore, another objective of the present invention is to providemultiple and flexible methods of capturing target objects as video dataand reconstructing 3D computerized models by utilizing either adedicated professional-level 3D model portal studio or consumer videorecording devices communicating with scalable cloud computing resources,wherein the consumer video recording devices are positioned in variousangles relative to the target objects to capture multi-angle videofootages prior to various calibration and computerized 3D modelreconstruction by the scalable cloud computing resources.

In addition, another objective of the present invention is to provide anovel electronic information sharing and exchange platform thataccommodates convenient 3D model contents sharing and monetization,especially for casual user-created 3D model contents.

Furthermore, another objective of the present invention is to provide areal-time 3D virtual and/or physical model-generating apparatus that canproduce a holographic projection or a physical replica of a 3D bodydouble upon user request via the novel electronic information sharingand exchange platform.

Yet another objective of an embodiment of the present invention is toprovide a business profit model for 3D content creators, electroniccontent sharing and monetization operators, and content viewers.

For the purpose of describing the invention, a term “three-dimensionalmodel,” or “3D model,” is defined as one or more computer-generatedthree-dimensional images, videos, or holograms. In a preferredembodiment of the invention, a computerized 3D model is created aftermulti-angle video data are extracted, transformed, and reconstructed bythree-dimensional graphics processing algorithms executed in a computersystem or in a cloud computing resource comprising a plurality ofnetworked and parallel-processing computer systems.

Furthermore, for the purpose of describing the invention, a term “cloud”is defined as a scalable data network-connected and/orparallel-processing environment for complex graphics computations,transformations, and processing. The data network-connected and/orparallel-processing environment can be provided using a physicalconnection, a wireless connection, or both. For example, a cloudcomputing resource comprising a first cloud computing server, a secondcloud computing server, and/or any additional number of cloud computingservers can each extract and transform a portion of multi-angle videodata simultaneously as part of a scalable parallel processing algorithm,which performs temporal, spatial, and photometrical calibrations, andexecutes depth map computation, voxel grid reconstruction, and deformedmesh generation. A scalable number of cloud computing servers enables areal-time or near real-time transformation and reconstruction of 3Dmodels after consumer video recording devices transmit multi-angle videodata to the cloud computing resource.

Moreover, for the purpose of describing the invention, a term“HoloPortal” is defined as a 3D model creation studio that incorporatescameras positioned on a multiple number of angles around a stage, wherea target object is placed for video footage recording at the multiplenumber of angles around the stage. The 3D model creation studio alsotypically incorporates a real-time or near real-time 3D reconstructionelectronic system, which is configured to perform silhouetteextractions, 3D voxel generation, 3D mesh generation, and texture anddetail-adding operations to create a user-controllable three-dimensionalmodel that resembles the target object.

In addition, for the purpose of describing the invention, a term“HoloCloud” is defined as a novel electronic system that captures livemulti-angle video feeds of a target object with portable electronicdevices and generates a user-controllable three-dimensional model byperforming various 3D reconstruction calculations and procedures in ascalable cloud computing network. In one example, a HoloCloud systemcomprises a plurality of common consumer-level video recording devices(e.g. smartphones, camcorders, digital cameras, etc.) positioned invarious angles surrounding a target object (e.g. a human, an animal, amoving object, etc.), a scalable number of graphic processing units(GPU's) in a scalable cloud computing platform, a 3D pre-processingmodule, a 3D reconstruction module, a background 3D graphics content, a360-degree virtual reality or video content, and a dynamic 3D modelcreated by the 3D reconstruction module. In one embodiment, the 3Dpre-processing module and the 3D reconstruction modules are graphicsprocessing software executed in the scalable number of graphicprocessing units (GPU's). In another embodiment, these modules may behard-coded specialized semiconductor chipsets or another hardware thatoperate in conjunction with the GPU's to provide 3D processing andreconstruction.

FIG. 1 shows a process diagram (100) for rapid three-dimensional modelgeneration from a dedicated real-time model reconstruction studio withmultiple camera angles, in accordance with an embodiment of theinvention. In a preferred embodiment of the invention, the dedicatedreal-time model reconstruction studio with multiple camera angles iscalled “HoloPortal.” HoloPortal is a 3D model creation studio with areal-time or near real-time 3D reconstruction system.

This 3D model creation studio is configured to place a target object(e.g. a human, an animal, or another moving object) in a designated areaof the 3D model creation studio that positions a plurality of cameras invarious angles around the designated area to capture multi-angle videofootages of the target object. Then, the multi-angle video footages areprocessed, transformed, and reconstructed as dynamic 3D models, whichmay include 3D mesh models, textures for all related frames, andmovement frames associated with the target object. After the dynamic 3Dmodels, also called herein as “3D body doubles” are generated from theHoloPortal, the dynamic 3D models can be stored in a 3D model database,which may be dynamically linked to an electronic social platform forsharing, monetizing, and viewing a variety of dynamic 3D models storedin the 3D model database. These dynamic 3D models may be generated in 3Dmodel formats such as OBJ's or COLLADA's.

In one example, as shown in the process diagram (100) of FIG. 1,HoloPortal first records multi-angle videos from a multiple number ofcameras surrounding the designated area. Then, the multi-angle videosundergo silhouette extractions, 3D voxel generation, 3D mesh generation,deformed 3D mesh generation, and texture-on-mesh generation to create a3D model, or a “3D body double” model through a variety of datatransformations and graphics reconstructions executed on graphicsprocessing units incorporated in or associated with the HoloPortal.

Preferably, the HoloPortal can generate 3D models (e.g. “3D bodydoubles”) and 3D contents in real-time or near real-time, withoutlengthy and laborious conventional methods of 3D content generationprocesses that can take many hours to many months. Furthermore, the 3Dmodels generated from the HoloPortal can be utilized in as characters ofa 3D computerized game, a 3D animation movie, an augmented realityapplication, or a virtual reality application. For example, a life-sized3D model (e.g. a “three-dimensional (3D) body double” model createdafter the multi-angle video capture of a human figure) may be createdand displayed in an augmented reality or virtual reality goggle or in ananother wearable electronic device. Moreover, a computerized 3D modelcreated from the HoloPortal may be physically manufactured with a 3Dprinting machine located within or outside the HoloPortal forcommercial, promotional, business, or transactional purposes.

FIG. 2 shows a rapid three-dimensional model generation process (200)from uncalibrated multiple sources of video recording of a targetedobject and subsequent cloud computing-based video data calibration andthree-dimensional reconstruction of the targeted object, in accordancewith an embodiment of the invention. In a preferred embodiment of theinvention, a novel electronic system that encompasses this rapidthree-dimensional model generation process (200) is called “HoloCloud.”Typically, the novel electronic system (i.e. HoloCloud) comprises aplurality of common consumer-level video recording devices (e.g.smartphones, camcorders, digital cameras, etc.) positioned in variousangles surrounding a target object (e.g. a human, an animal, a movingobject, etc.), a scalable number of graphic processing units (GPU's) ina scalable cloud computing platform, a 3D pre-processing module, a 3Dreconstruction module, a background 3D graphics content, a 360-degreevirtual reality or video content, and a dynamic 3D model created by the3D reconstruction module.

As shown in the rapid three-dimensional model generation process (200)of FIG. 2, the plurality of common consumer-level video recordingdevices generate a plurality of digitized video feeds (e.g. Video 1,Video 2, . . . Video n) in various angles for a target object, and thenutilizes an integrated or standalone wireless transceiver (e.g. acellular transceiver, a WiFi LAN transceiver, etc.) to transmit theplurality of digitized video feeds to a HoloCloud graphics processingunit (GPU) in a cloud computing platform. In a preferred embodiment, theHoloCloud GPU incorporates a pre-processing module and a 3Dreconstruction module. The pre-processing module is configured tocalibrate temporal, spatial, and photometrical variables of themulti-angle digitized video feeds, and is also able to generatebackground 3D geometry and 360-degree virtual reality video. The 3Dreconstruction module is configured to provide depth map computations,voxel grid reconstructions, and deformed mesh generations for eventualgeneration of dynamic 3D models.

After numerous internal stages of video extractions, transformations,and reconstruction through the HoloCloud GPU, the background 3D graphicscontent, the 360-degree virtual reality or video content, and thedynamic 3D model are electronically generated and subsequently utilizedas 3D figures or graphics in a virtual reality application, in anaugmented reality application, or in a 3D printing of a physical 3Dmodel made of plastic, rubber, or metallic composite materials.

FIG. 3 shows pre-processing and reconstruction procedures (300) in cloudcomputing-based video data calibration and three-dimensionalreconstruction of the targeted object, in accordance with an embodimentof the invention. In this embodiment of the invention, a multiple numberof common consumer-level video recording devices generate a plurality ofdigitized video feeds (e.g. Video 1, Video 2, . . . Video n) in variousangles for a target object, and then transmit the plurality of digitizedvideo feeds to a HoloCloud graphics processing unit (GPU) in a cloudcomputing platform. Typically, the cloud computing platform is acollective number of graphics computing machines that are dynamicallyscalable to deploy and assign a flexible number of GPU's for parallelprocessing, depending on the intensity of graphics computation,transformation, and reconstruction requirements for the plurality ofdigitized video feeds. For example, a larger number of GPU's may beassigned to perform 3D graphics processing if the plurality of digitizedvideo feeds has a high video feed count, long durations, and/or higherresolutions. In contrast, a smaller number of GPU's may be assigned toperform 3D graphics processing if the plurality of digitized video feedshas a low video feed count, short durations, and/or lower resolutions.

As shown in the pre-processing and reconstruction procedures (300) incloud computing-based video data calibration and three-dimensionalreconstruction of the targeted object, each HoloCloud GPU canincorporate a pre-processing module and a 3D reconstruction module. Thepre-processing module executes calibration of temporal, spatial, andphotometrical variables of the multi-angle digitized video feeds, and isalso able to generate background 3D geometry and 360-degree virtualreality video. The 3D reconstruction module, on the other hand, performsdepth map computations, voxel grid reconstructions, and deformed meshgenerations for eventual generation of dynamic 3D models or characters.

After numerous internal stages of video extractions, transformations,and reconstruction through one or more HoloCloud GPU's that aretypically configured to scale and parallel-process a varying amount ofworkload for 3D content generation, the background 3D geometry graphicscontent, the 360-degree virtual reality video content, and the dynamic3D model are electronically generated and subsequently utilized as 3Dfigures or graphics in a virtual reality application, in an augmentedreality application, or in a 3D printing of a physical 3D model made ofplastic, rubber, or metallic composite materials.

The novel electronics system utilizing a plurality of commonconsumer-level video recording devices for multi-angle video feeds of atarget object and a scalable number of HoloCloud GPU's for videoextractions, transformations, and reconstruction of dynamic 3D modelsenables casual consumers to capture and generate 3D graphics contentsrapidly and inexpensively, without necessitating specialized 3D contentrecording equipment and/or high-powered 3D graphics computing equipmenton site that are typically required in conventional 3D contentgeneration. Furthermore, by wirelessly transmitting the recordedmulti-angle video feeds to a scalable number of HoloCloud GPU's executedin a cloud computing network that processes high-powered graphicscomputing tasks to generate dynamic 3D models, the casual consumer isnot required to have an expert knowledge of 3D graphics pre-processingand reconstruction processes that may be electronically executed by athird-party HoloCloud service operator. Therefore, various embodimentsof the present invention enable convenient and pervasive casualuser-created dynamic 3D models and 3D contents, which were previouslydifficult to generate with conventional 3D content generation solutions.

FIG. 4 shows a novel process (400) embodying two methods of ubiquitousand rapid three-dimensional model content generation by casual (i.e.non-graphics expert) consumers and robust social sharing of virtualreality contents in a 3D content sharing platform, in accordance withone or more embodiments of the invention. A first method of ubiquitousand rapid three-dimensional model content generation involves adedicated 3D content generation studio (i.e. “HoloPortal”) that allows acasual consumer to walk into a HoloPortal facility to capturemulti-angle video feeds from professionally installed multiple camerassurrounding a targeted area in the HoloPortal for a dynamic 3D modelgeneration from onsite graphics processing units. Furthermore, a secondmethod of ubiquitous and rapid three-dimensional model contentgeneration involves a plurality of consumer cameras at any location of acasual consumer's choice to capture multi-angle video feeds around atarget object, wherein the multi-angle video feeds are subsequentlytransmitted to a cloud computing resource specializing in 3D graphicsprocessing to generate a dynamic 3D model. The second method of thedynamic 3D model generation is called “HoloCloud,” as describedpreviously and as also shown in FIG. 4.

Once dynamic 3D models are generated by a HoloPortal system or aHoloCloud system, they can be incorporated or synthesized into variouselectronic applications, such as virtual reality applications, augmentedreality applications, 3D animation movies, and 3D-printed physical 3Dmodels, as shown in FIG. 4. In a preferred embodiment, a user is able tomake a request to produce, purchase, or sell a physical replica of anelectronic 3D model from an apparatus that comprises a 3D printerdevice, a 3D content database, a 3D content sharing management software,and a client-side 3D content transaction user interface, which areconnected to the HoloPortal system and/or the HoloCloud system. In thisexample, a physical 3D model made of plastic, metallic, or compositematerials may be created by the 3D printer device.

In another example, a dynamic 3D model can be displayed as a life-sizedvirtual model in a wearable computing device, such as a virtual realitygoggle or a hologram display projector or machine Preferably, the useris able to also make a request to produce, purchase, or sell a hologramobject associated with an electronic 3D model from an apparatus thatcomprises a hologram display machine, a 3D content database, a 3Dcontent sharing management software, and a client-side 3D contenttransaction user interface, which are connected to the HoloPortal systemand/or the HoloCloud system.

Furthermore, the dynamic 3D models can be uploaded, listed, and sharedon an electronic 3D model and content sharing platform that connectscontent creators, distributors, service providers, and content viewers.The electronic 3D model and content sharing platform may also providepaid viewing as well as complimentary viewing features based on contentaccess permission parameters configured by the content creators and/orthe distributors.

FIG. 5 shows an electronic social sharing platform (500) for casualconsumer's 3D and/or virtual reality contents generated from a dedicatedstudio system (HoloPortal) or from a plurality of consumer devicesconnected to a cloud-based 3D model generation system (HoloCloud), inaccordance with an embodiment of the invention. In a preferredembodiment, the electronic social sharing platform (500) is configuredto upload, list, and share 3D model animations and 3D contents that aretypically created by casual content creators (e.g. consumers with nocomputer graphics creation expertise or training). The electronic socialsharing platform (500) may also accommodate pay-per-view or timed rentaltransactions that are required by the casual content creators andpurchased by content viewers who are also accessing the electronicsocial sharing platform (500).

In a preferred embodiment, the electronic social sharing platform (500)is connected to a 3D model and content database, and is configured todisplay dynamic 3D models and 3D contents through a display userinterface, as shown in FIG. 5. Preferably, the dynamic 3D models and the3D contents are initially created from a HoloPortal system or aHoloCloud system by a casual (i.e. non computer graphics expert) contentcreator, who then uploads the dynamic 3D models and the 3D contents(e.g. “3D body doubles”) to the electronic social sharing platform (500)for listing and managed distribution of contents to content viewers. Insome embodiments of the invention, the electronic social sharingplatform (500) may be operated and managed by a content distributor or acontent service provider. In other embodiments of the invention, theelectronic social sharing platform (500) may be operated and managed bya group of content creators and/or content viewers.

Furthermore, in one embodiment, a client-side 3D content viewer andmanagement user interface is executed on a notebook computer, a desktopcomputer, a mobile communication device, or another consumer electronicdevice to enable a user to access, control, and manage a variety of 3Dcontents available in the electronic social sharing platform. In oneexample, the client-side 3D content viewer and management user interfaceis a mobile application executed on an Android OS-powered or iOS-poweredmobile device. In another example, the client-side 3D content viewer andmanagement user interface is a Windows-based or Mac OS-based computerapplication program. Yet in another example, the client-side 3D contentviewer and management user interface is a web user interface accessiblevia a website. The client-side 3D content viewer and management userinterface is configured to purchase, sell, transmit, receive, orplayback a 3D content incorporating a 3D body double model, which istypically generated from a HoloPortal or HoloCloud system. Preferably,the client-side 3D content viewer and management user interface isconfigured to communicate with an electronic 3D content sharing softwareand a 3D model and content database, which are executed on a computerserver that manages the electronic social sharing platform (500).

Moreover, the electronic social sharing platform (500) may authorize acontent viewer to download a desired dynamic 3D model or 3D content as a3D file that can be played on a standalone 3D content player unit, orinstead authorize the content viewer to play the desired dynamic 3Dmodel or 3D content on an online web viewer unit linked to theelectronic social sharing platform (500). The online web viewer unit orthe standalone 3D content player unit may be executable and displayablefrom a desktop computer, a notebook computer, a tablet computer, a smartphone, a specialized 3D display device, or another electronic device. Ifdynamic 3D model and/or 3D content files are downloaded directly to aconsumer's electronic device, the dynamic 3D model and/or 3D contentfiles may be repurposed as objects synthesized in 3D games, 3Danimations, 3D games, virtual reality contents, or augmented realitycontents. Furthermore, the dynamic 3D model and/or 3D content files mayalso be utilized in a 3D printing machine to manufacture a physical 3Dmodel.

FIG. 6 shows a business model example (600) for content generators,content viewers, and an electronic social sharing platform for 3D modelcontents, in accordance with an embodiment of the invention. In thisbusiness model example (600), a content viewer who purchases a virtualreality or augmented reality 3D content, a 3D animation, a 3D game, or a3D printer-produced object pays a specified fee (e.g. $1.00) through theelectronic social sharing platform for 3D model contents. Then, thespecified fee (e.g. $1.00) is divided between a service operator (e.g. acompany called “DoubleMe”) and a content creator/owner who utilized aHoloPortal system or a HoloCloud system to generate dynamic 3D modelsand 3D contents, as shown in FIG. 6.

In a preferred embodiment of the invention, the service operator mayprovide and manage a 3D content database and the electronic socialsharing platform for 3D model contents that incorporate an online 3Dcontent player and/or a 3D file download feature to the content viewer.Furthermore, in some cases, the service operator may also provide andmanage the HoloPortal system and the HoloCloud system to enable thecontent creator/owner to generate the dynamic 3D models and 3D contents.As an example of compensation, the service operator may take 40 percent(e.g. $0.40) of the specified fee (e.g. $1.00) paid by the contentviewer, while the content creator/owner may take 60 percent (e.g. $0.60)of the specified fee (e.g. $1.00). As the business model example (600)is merely an example of such financial compensation arrangements,specific compensation structures for various embodiments of the presentinvention may vary, with various proportions of the specified feeassigned to the service operator and the content creator/owner.Furthermore, in some embodiments of the invention, the service operatormay simply be a non-profit group of content viewers and contentcreators/owners.

In the preferred embodiment of the invention, the specified fee (e.g.$1.00) required for downloading or watching a particular 3D model or 3Dcontent may be set by the content creator/owner and/or the serviceoperator. Furthermore, the specified fee may vary, depending on thecontent viewer's request to download or simply replay the particular 3Dmodel or 3D content on an online 3D content player. For example, thespecified fee may be higher for a locally-downloaded importable file ofthe particular 3D model or 3D content, while the specified fee may belower for a mere online replay of the particular 3D model or 3D content.

FIG. 7 shows third party add-on applications (700) to the 3D modelgeneration, social content sharing, and monetization systems, inaccordance with an embodiment of the invention. Examples of third partyadd-on applications (700) include, but are not limited to, 3D medicalscanning applications (e.g. for gait and brain injuries), 3Dvirtual-fitting applications, sports or motion 3D analysis applications,diet/weight loss analysis applications with 3D modeling, and 3Dergonomics analysis applications for custom manufacturing applications.

The third party add-on applications may utilize dynamic 3D modelscreated from a HoloPortal system or a HoloCloud system by contentcreators or owners. Furthermore, the third party add-on applications maybe configured to transmit 3D modeling data to or receive 3D modelingdata from 3D social content sharing and 3D content monetization systems.Moreover, a service operator for an electronic social sharing platformfor 3D model contents may provide a third party developer softwaredevelopment kit (SDK) to third-party application developers to create adiverse set of third party add-on applications for the 3D modelgeneration, social content sharing, and monetization systems, asdisclosed in various embodiments of the present invention.

One or more rapid three-dimensional model generation systems, such asHoloPortal and HoloCloud systems, a 3D virtual reality model sharing andmonetization electronic platform system, and a real-time 3D virtualand/or physical model-generating apparatus have been disclosed in thedescriptions above and also in the corresponding drawings. Variousembodiments of the present invention exhibit several advantages overconventional electronic methods and systems for 3D content generation,sharing, and monetization.

For example, one advantage of an embodiment of the present invention isproviding a real-time 3D virtual and/or physical model-generatingapparatus that can rapidly and inexpensively produce a holographicprojection and/or a physical replica of a 3D body double byincorporating a 3D printer and a hologram display machine into aHoloPortal or HoloCloud system.

Another advantage of an embodiment of the present invention is providingconvenient and flexible methods and systems for rapidly capturing targetobjects as video data and reconstructing 3D computerized models byutilizing either a dedicated professional-level 3D model portal studioor consumer video recording devices communicating with scalable cloudcomputing resources. These convenient and flexible methods and systemsfor 3D model generation lower the barrier of entry for an everydayconsumer to create, share, and monetize 3D models, thus encouraging awidespread consumer utilization of casual user-created 3D models overthe Internet.

Furthermore, the 3D virtual reality model sharing and monetizationelectronic platform system, as illustrated in FIGS. 4-7 and as describedabove, creates a vibrant electronic marketplace for posting, sharing,selling, and buying casual user-created 3D “body double” models andother 3D contents, which were largely unattainable with conventional andexpensive professional 3D recording and reproduction equipment that weretypically beyond the reach of a consumer for purchase and utilization.

In addition, an embodiment of the present invention provides a novelcloud-based electronic system that can inexpensively capture live targetobjects as multiple-angle videos and rapidly generate 3D models withcommon consumer video recording equipment and cloud computing resources,at a fraction of a cost for producing 3D models using conventional 3Dmodel generation equipment.

While the invention has been described with respect to a limited numberof embodiments, those skilled in the art, having benefit of thisdisclosure, will appreciate that other embodiments can be devised whichdo not depart from the scope of the invention as disclosed herein.Accordingly, the scope of the invention should be limited only by theclaims.

What is claimed is:
 1. A real-time 3D virtual and physical bodydouble-generating apparatus comprising: a HoloPortal electronic systemthat incorporates a dedicated physical studio space, which is configuredto capture, calibrate, calculate, reconstruct, and generate graphicaltransformation of a target object to create an electronic 3D body doublemodel; a HoloCloud electronic system comprising consumer-level portablevideo recording devices positioned circularly around the target objectand generate a plurality of multiple-angle video data streams, ascalable number of graphics processing units (GPU's) that execute apre-processing module and a 3D reconstruction module for calibrating,calculating, reconstructing, and generating graphical transformations tocreate the electronic 3D body double model that resembles the targetobject, and a wireless transceiver that transmits the plurality ofmultiple-angle video data streams from the consumer-level portable videorecording devices to the scalable number of GPU's; a 3D printer deviceconnected to at least one of the HoloPortal electronic system and theHoloCloud electronic system, wherein the 3D printer device manufacturesa physical replica of the electronic 3D body double model previouslycreated by the HoloPortal electronic system or the HoloCloud electronicsystem, when a user requests production of the physical replica; a 3Dmodel and content database configured to store the electronic 3D bodydouble model created from the HoloPortal electronic system or theHoloCloud electronic system; an electronic 3D content sharing softwareexecuted on a computer server connected to the 3D model and contentdatabase, wherein the electronic 3D content sharing software isconfigured to upload, list, transmit, and share 3D model animations and3D contents derived from the electronic 3D body double model, andwherein the electronic 3D content sharing software is further configuredto accommodate a user request to purchase or sell the physical replicaof the electronic 3D body double model; and a client-side 3D contentviewer and management user interface executed on a notebook computer, adesktop computer, a mobile communication device, or a web server,wherein the client-side 3D content viewer and management user interfaceis configured to purchase, sell, transmit, receive, or playback a 3Dcontent incorporating the electronic 3D body double model via theelectronic 3D content sharing software and the 3D model and contentdatabase.
 2. The real-time 3D virtual and physical bodydouble-generating apparatus of claim 1, further comprising a hologramdisplay machine configured to project the electronic 3D body doublemodel as a hologram after a user's hologram projection request isprocessed via the client-side 3D content viewer and management userinterface, the electronic 3D content sharing software, and the 3D modeland content database.
 3. The real-time 3D virtual and physical bodydouble-generating apparatus of claim 1, wherein the pre-processingmodule calibrates temporal, spatial, and photometrical variables of themultiple-angle video data streams, and generates background 3D geometryand 360-degree virtual reality video data.
 4. The real-time 3D virtualand physical body double-generating apparatus of claim 1, wherein the 3Dreconstruction module provides depth map computations, voxel gridreconstructions, and deformed mesh generations for creation of theelectronic 3D body double model, which resembles the target object. 5.The real-time 3D virtual and physical body double-generating apparatusof claim 1, wherein the client-side 3D content viewer and managementuser interface is a mobile application for the mobile communicationdevice.
 6. The real-time 3D virtual and physical body double-generatingapparatus of claim 1, wherein the client-side 3D content viewer andmanagement user interface is a computer application for the notebookcomputer or the desktop computer.
 7. The real-time 3D virtual andphysical body double-generating apparatus of claim 1, wherein theclient-side 3D content viewer and management user interface is a webinterface accessible via a web browser on a consumer's electronicdevice, which is connected to the web server.
 8. The real-time 3Dvirtual and physical body double-generating apparatus of claim 1,wherein the 3D model animations and 3D contents derived from theelectronic 3D body double model are shared, bought, and sold from oneentity to another entity over the electronic 3D content sharing softwareexecuted on the computer server connected to the 3D model and contentdatabase.